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Abstract  As  the  Alzheimer’s  disease  field  moves  to  studies  and  intervention  trials  in  the  preclinical  phase 
and  early  prodromal  period,  it  will  be  necessary  to  measure  everyday  function  in  an  increasingly  more 
sensitive  and  sophisticated  way  to  capture  more  subtle  impairments.  One  approach  to  increasing  sensitivity 
in  functional  measures  is  to  use  performance  based  instruments,  such  as  the  UCSD  Performance-based 
Skills  Assessment 

(UPSA),  in  Mild  Cognitive  Impairment  (MCI)  or  mild  Alzheimer’s  disease  (AD)  research.  In  this  test  patients 
are  observed  and  their  response  scored  as  they  actually  perform  proxies  for  real  world  tasks  and  it  contrasts  with 
more  typical  informant  based  measures.  In  a  preliminary  study  we  compared  patients  with  MCI,  patients  with 
mild  AD  who  by  diagnosis  have  functional  impairments,  and  healthy  age  matched  controls  on  the  UPSA,  as 
well  as  measures  of  cognition  (e.g.,  episodic  memory,  semantic  memory,  executive  function,  speed).  We  found 
that  patients  with  MCI  had  compromises  in  everyday  functional  competence  and  that  the  UPSA  was  strikingly 
sensitive  to  these  (Goldberg  et  al,  2010).  Additionally  the  UPSA  outperformed  an  informant  based  measure  on 
a  variety  of  criteria.  However ,  that  study  was  not  longitudinal.  Therefore,  it  is  important  that  we  obtain  data  on 
the  longitudinal  characteristics  of  the  UPSA  in  these  populations,  including  the  severity  of  decline  in  this 
measure  over  time,  the  relationship  of  decline  to  cognitive  changes  in  order  to  determine  the  validity  of  the 
UPSA,  and  its  technical  psychometric  characteristics  (e.g.,  test-retest  reliability). 

In  the  present  longitudinal  study  we  found  large  between  group  differences  on  the  UPSA,  such  that  HCs 
outperformed  MCI  individuals,  who  in  turn  outperformed  AD  individuals.  We  found  a  significant  effect  of 
time,  such  that  overall,  groups  declined  over  a  one  year  period.  While  we  did  not  find  a  group  by  time 
interaction,  it  was  the  case  that  in  terms  of  effect  sizes  decline  in  the  MCI  and  AD  groups  was  medium,  while 
for  HCs,  it  was  small..  Psychometrically  the  UPSA  showed  very  good  test-retest  reliability.  Additionally, 
correlations  between  the  long  form  and  short  form  were  very  high.  However,  a  practice  effect  was  noted  at  six 
weeks. 


Introduction  As  the  Alzheimer’s  disease  field  moves  to  studies  and  intervention  trials,  it  will  be  necessary  to 
measure  everyday  function  in  an  increasingly  more  sensitive  and  sophisticated  way  to  capture  more  subtle 
impairments.  One  approach  to  increasing  sensitivity  in  functional  measures  is  to  use  performance  based 
instruments,  such  as  the  UCSD  Performance-based  Skills  Assessment  (UPSA),  in  Mild  Cognitive  Impairment 
(MCI)  or  mild  Alzheimer’s  disease  (AD)  research.  In  this  test  patients  are  observed  and  their  response  scored 
as  they  actually  perform  proxies  for  real  world  tasks  (such  as  determining  which  bus  route  to  take,  writing  a 
check,  planning  a  trip  to  the  beach,  and  recalling  an  appointment’s  time  and  place).  In  a  preliminary  study  we 
compared  patients  with  MCI,  patients  with  mild  AD  who  by  diagnosis  have  functional  impairments,  and 
healthy  age  matched  controls  on  the  UPSA,  as  well  as  measures  of  cognition  (e.g.,  episodic  memory,  semantic 
memory,  executive  function,  speed).  We  found  that  patients  with  MCI  had  compromises  in  everyday 
functional  competence  and  that  the  UPSA  was  strikingly  sensitive  to  these  (Goldberg  et  al,  2010).  However, 
that  study  was  not  longitudinal.  Since  our  initial  review  several  new  measures  of  everyday  function  have  been 
introduced.  However,  these  are  informant  based  and  may  be  subject  to  informant  biases,  lack  of  knowledge,  or 
imprecision. 

Therefore,  it  is  important  that  we  obtain  data  on  the  longitudinal  characteristics  of  the  UPSA  in  these 
populations,  including  the  severity  of  decline  in  this  measure  over  time,  the  relationship  of  decline  to  cognitive 
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changes  in  order  to  determine  the  validity  of  the  UPS  A,  and  its  technical  psychometric  characteristics  (e.g.,  test- 
retest  reliability).  We  will  longitudinally  assess  magnitude  of  decline  in  the  UPS  A  individuals  with  MCI  and 
mild  AD  assessed  at  baseline,  6  weeks,  and  12  months.  We  will  compare  and  contrast  decline  in  the  UPSA  with 
a  commonly  used  measure  of  function  administered  to  informants  (the  FAQ)  in  MCI  and  AD  using  Effect  Sizes 
(ES)  and  mixed  model  repeated  measures.  We  will  determine  the  cognitive  measures  that  best  predict  decline  in 
the  UPSA.  We  predict  that  the  UPSA  will  decline  over  time  in  the  MCI  and  AD  groups  with  and  demonstrate 
strong  relationships  to  cognitive  decline 


Key  Research  Accomplishments 

•  Recruitment  of  subjects  for  baseline  evaluation  and  longitudinal  follow  up.  To  date  77  subjects  have 
been  enrolled  and  data  were  analyzed  in  this  report  (see  below).  A  total  of  183  assessments  were 
completed. 

•  Implementation  of  testing  procedures  and  screening  procedures.  Entry  of  data  into  our  database. 

•  We  answered  key  scientific  questions  listed  in  our  Aims.  In  particular  we  found  that  psychometric 
properties  of  the  UPSA  were  robust;  that  the  UPSA  was  sensitive  to  diagnostic  class  such  that  HCs 
>MCI>AD  in  terms  of  UPSA  performance;  that  in  MCI  and  AD  cohorts  over  the  one  year  period  of 
follow  up,  UPSA  performance  declined;  and  that  UPSA  short  form  and  long  form  were  highly 
correlated.  We  also  noted  a  practice  effect  for  the  UPSA  at  six  weeks  that  was  reduced  by  one  year  in 
HCs  and  to  a  lesser  extent,  MCI. 


Methods 

Subjects 

Recruitment  began  September  21,  2012  with  North  Shore-LH  IRB  and  ORP  approval.  For  the  analyses 
presented  here,  36  healthy  controls  (HCs),  10  individuals  with  Mild  Cognitive  Impairment  (MCI),  and  14 
individuals  with  Alzheimer’s  disease  (AD)  were  included  at  baseline.  Retention  rates  for  these  subjects  over  the 
course  of  this  one  year  longitudinal  study  (with  three  assessments)  was  high  at  >60%.  Nevertheless,  as  these 
sample  sizes  are  below  are  recruiting  goals.  In  order  to  rectify  this  we  requested  a  No  Cost  Extension  (see 
Appendix)  and  successfully  recruited  16  participants  over  this  period  (as  well  as  completed  examinations  of 
subjects  who  entered  the  study  earlier). 

Demographic  data  are  in  Table  1.  Mean  ages  of  the  groups  were  in  the  73  to  75year  range.  Sex  ratio  was  more 
or  less  equivalent  across  groups,  though  slightly  favoring  males.  The  groups  were  well-educated  with 
approximately  16  years  of  education. 

Instrument 

The  long  form  of  the  UPSA  included  comprehension  and  planning,  communication,  finance,  and  transportation 
subtests.  The  short  form  included  the  comprehension  and  planning  and  communication  subtests  only. 
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Results  and  Discussion 


Test  retest  reliability  (over  a  six  week  period)  was  high  in  the  sample  at  r>.89  for  the  long  form  and  .83  for  the 
short  form  (psc.OOOl).  Small  but  measureable  practice  effects  were  present  in  the  6- week  condition  in  the  HC 
and  MCI  groups.  Ceiling  effects  were  negligible  in  the  MCI  and  AD  groups.  In  the  HC  group  they  were  14%. 
The  long  and  short  UPSA  forms  had  a  correlation  of  .96. 

One  of  our  key  analyses  consisted  of  a  mixed  model  repeated  measures  ANOVA  on  the  UPSA  scores.  Mixed 
models  do  not  exclude  subjects  with  missing  data  and  are  the  statistic  of  choice  in  longitudinal  designs. 
Diagnostic  group  was  a  main  effect,  time  (baseline,  6  weeks,  one  year)  was  a  within  subjects  effect,  and 
diagnosis  *time  was  the  interaction  term.  Results  were  as  follows  for  both  the  long  and  short  form: 

1.  A  highly  main  effect  of  diagnostic  group  was  present:  HCs>MCI>AD  in  UPSA  performance  (pc. 001). 

2.  A  robust  effect  of  time  was  present  (with  declining  scores)  (pc.05). 

3.  No  diagnosis  *time  interaction  was  present. 

Results  are  displayed  in  Figures  1  and  2.  The  HC  group  was  stable  over  a  one  year  period.  The  AD  group 
demonstrated  a  consistent  decline. 

To  understand  these  results  more  completely  we  a  used  effect  sizes  expressed  as  Cohen’s  d.  First,  we  examined 
group  differences.  We  found  consistently  medium  to  large  effect  sizes  in  contrasts  between  HC  and  the  two 
impaired  groups  (MCI  and  AD)  at  baseline  and  at  one  year.  Additionally,  MCI  subjects  performed  better  than 
AD  subjects  with  a  large  effect  size. 

Next,  we  examined  within  subject  time  differences.  For  the  HC  group  performance  was  quite  stable.  For  the 
MCI  and  AD  groups  the  difference  between  baseline  and  one  year  performance  (especially  on  the  UPSA  short) 
yielded  effect  sizes  that  were  medium  (ie,  .4  to  .6),  indicating  decline. 

Over  six  weeks  the  practice  effect  in  Cohens  d  effect  size  units  was  less  than  .20  in  the  HC  group  and  in  the 
MCI  group  (i.e.,  small)  for  the  long  form.  Practice  effects  were  slightly  larger  for  the  short  form  of  the  UPSA 

The  correlation  between  the  long  form  and  short  form  of  the  UPSA  was  .94  (pc. 0001).  Given  the  high 
correlation  between  the  two  forms  of  the  test  and  their  high  test-retest  reliabilities,  as  well  as  the  sensitivity  to 
decline  in  the  short  form,  we  suggest  that  the  short  form  will  be  utilized  more  frequently  for  pragmatic  reasons 
(because  it  takes  less  time  to  administer). 

In  summary,  these  results  suggest  that  the  UPSA  is  sensitive  to  group  differences  in  functional  competence.  As 
predicted,  MCI  and  AD  subjects  performed  worse  than  HCs.  Moreover  AD  subjects  demonstrated  a  medium 
effect  sized  decline  over  one  year  as  did  MCI  subjects  (notably  on  the  short  form  UPSA).  .  Psychometric 
properties  of  the  UPSA  were  good  in  terms  of  test-retest  reliability,  ceiling,  and  floor  effects.  Because  the  short 
UPSA  and  Long  UPSA  were  highly  correlated  we  would  recommend  the  short  form  of  the  UPSA  if  time  and 
fatigue  are  issues  ina  given  study. 
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Demographics  of  HC,  MCI, 
and  AD  Groups-S+udy  2 


HC 

(N=43) 

MCI 

(N=20) 

AD 

(N=26) 

Age 

73.8  ±  10.8 

74.9  ±8.4 

74.7  ±  9.2 

Sex  fm/f) 

21/22 

8/12 

11/15 

Ed. 

16.5  ±2.9 

16.8  ±3.2 

14.7  ±3,6 

MMSE 

28.7+1.6 

26.3+2.9 

20.4+4.4 
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Figure  1 


UP5A  Long  scores  over  time 

Group  p<  .0001,  time  p=  02,  group  x  time  =13 
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Figure  2 


UPSA  Short  percentage  scores  over  time 

droup  p<  .001,  time  p=  001,  group  x  time  p  =  ,23 


IS  Means  UP5A  Percentage  Short 
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Figure  3 


Effect  Size  UPSA  Long  (Between 
Groups) 
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Figure  4 


Effect  Size  fop  UPSA  Short 
(Between  Groups) 
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Figure  5 


Effect  Size  UPS  A  Long  (within 
subject) 
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Figure  6 


Effect  Sizes  URSA  Short  (within 
subject) 
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Table  1  Group  Demographics 


Group 

Age 

Gender 

Education 

n(baseline) 

n(6  week  s) 

n(l  year) 

Healthy 

Control 

71.5 

(12.03) 

53%  male 

16.61  (2.57) 

36 

31 

26 

Mild  Cognitive 
Impairment 

72.8 

(10.16) 

50%  male 

17.2  (2.25) 

10 

9 

5 

Alzheimer's 

Disease 

74(10.05) 

50%  male 

15.5  (3.37) 

14 

8 

8 
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Table  2.  Descriptive  data  for  the  UPS  A  long  and  short  forms 


Diagnosis=HC 


Variable 

Mean 

Std  Dev 

Minimurr 

Maximurr 

N 

MMSE_BL 

28.9166667 

1.5189282 

23.0000000 

30.0000000 

36 

UPSA-  _SHORT_1 

88.3230453 

6.1787890 

74.0740741 

100.0000000 

36 

UPSA _ LONG_1 

89.7802095 

6.7589245 

73.4680135 

100.0000000 

36 

MMSE_6WK 

28.3548387 

1 .7425726 

22.0000000 

30.0000000 

31 

UPSA_ 

SHORT 2 

90.3823178 

7.0988087 

75.9259259 

100.0000000 

31 

UPSA _ LONG_2 

92.5811882 

5.0450183 

81.7508418 

100.0000000 

31 

MMSE_1  YR 

28.6923077 

1 .5432234 

24.0000000 

30.0000000 

26 

UPSA_ 

_SHORT_3 

87.6153846 

8.0147195 

68.5185185 

98.1481481 

26 

UPSA _ LONG_3 

90.9790210 

6.9215856 

72.4915825 

99.0740741 

26 

Diagnosis=MCI 


Variable 

Mean 

Std  Dev 

Minimurr 

Maximurr 

N 

MMSE_BL 

27.0000000 

2.3570226 

21.0000000 

30.0000000 

10 

UPSA-  _SHORT_1 

77.0370370 

9.1641203 

64.8148148 

90.7407407 

10 

UPSA _ LONG_1 

84.2912458 

5.7579939 

72.8619529 

90.8249158 

10 

MMSE_6WK 

26.3333333 

2.0615528 

24.0000000 

29.0000000 

9 

UPSA_ 

_SHORT_2 

80.8641975 

10.7183675 

62.9629630 

96.2962963 

9 

UPSA _ LONG_2 

86.5937149 

8.7528287 

71.9360269 

95.8754209 

9 

MMSE_1  YR 

26.2000000 

1.6431677 

25.0000000 

28.0000000 

5 

UPSA_ 

_SHORT_3 

75.1851852 

8.7449770 

64.8148148 

83.3333333 

5 

UPSA _ LONG_3 

83.9562290 

6.1380319 

75.5892256 

91.6666667 

5 

Diagnosis=AD 


Variable 

Mean 

Std  Dev 

Minimurr 

Maximurr 

N 

MMSE_BL 

20.3571429 

5.2857885 

11.0000000 

28.0000000 

14 

UPSA-  _SHORT_1 

55.0264550 

21.6501455 

12.9629630 

83.3333333 

14 

UPSA _ LONG_1 

53.8768639 

29.8509381 

6.4814815 

91.6666667 

14 

MMSE_6WK 

20.5000000 

4.7809144 

14.0000000 

28.0000000 

8 
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UPSA_ 

_SHORT_2 

55.3240741 

23.0965032 

18.5185185 

74.0740741 

8 

UPSA _ LONG_2 

59.0256734 

30.9748460 

9.2592593 

83.8383838 

8 

MMSE_1  YR 

20.2500000 

5.7008771 

8.0000000 

25.0000000 

8 

UPSA_ 

_SHORT_3 

47.2222222 

21.2300557 

3.7037037 

74.0740741 

8 

UPSA _ L0NG_3 

51.3383838 

27.7088757 

1.8518519 

84.7643098 

8 
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Appendix  I 


The  Feinstein  Institute 

for  Medical  Research  shoreUj 

The  Litwin-Zucker  Research  Center 
for  the  Study  of  Alzheimer's  Disease 

350  Community  Drive.  4th  floor 
Manhanet  New  York  1 1 030 
Tel  (516)  563-3493 

Fax  (5 16)  562-0401  March  10,  2015 

The  Feinstein  Institute  for  Medical  Research 
Ms.  Rita  Nigh 

Office  of  Grants  and  Contracts 
350  Community  Drive 
Manhasset,  NY  11030 
(516)  562-3106 

Project  Officer,  Cheryll  Quirin 

Telemedicine  and  Advanced  Technology  Research  Center  (TATRC) 

US  Army  Medical  Research  and  Materiel  Command  (USAMRMC) 

Fort  Detrick,  MD  21702 

Dear  Ms.  Quirin, 

I  am  writing  to  request  a  no  cost  extension  (NCE)  for  a  period  of  12  months  under  Award  No. 
W81XWH-1 2-1 -0084  through  April  15.  2016  for  the  project  entitled  "Longitudinal  Study  of  a 
Novel,  Performance-based  Measure  of  Everyday  Functional  Competence".  The  award  is 
currently  scheduled  to  end  on  April  15,  2015. 

The  progress  on  this  project  was  delayed  because  of  slowed  recruiting  for  this  ambitious 
study.  While  we  have  recruited  nearly  70  subjects  with  excellent  retention  across  the  one 
year  longitudinal  study  period  (incorporating  3  assessments,  for  a  total  of  nearly  200 
assessments)  we  appreciate  the  need  for  more  subjects  to  test  our  hypotheses  fully.  We  will 
continue  to  seek  ORP  and  IRB  approval  for  this  ongoing  study. 

The  current  award  is  fully  spent,  and  we  will  use  internal  funds  to  support  the  study  during 
the  extension,  including  the  post-doctoral  fellow,  study  coordinator /recruiter, 
psychometrician,  physician,  and  Principal  Investigator  time  and  effort  during  this  period. 


Also  enclosed  please  find  an  updated  SOW  and  revised  timeline.  Thank  you  for  your 
understanding  and  assistance. 


Enc. 

Cc:  Dr.  Anthony  Pacifico 
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